Attention to detail is everything; carefully review the description. We are an early-stage startup looking to hire a part-time data engineer. The potential candidate will go through a provis...granted options when a deal is closed. A bonus may be included depending on performance. If the aforementioned sounds like you, you’re onto a great you built & optimized data pipelines for speed? Added data backups? Have you prepared data for ML applications? We use Google Cloud Platform. Tools to be used: & in python or Go. And no, we will not being using AWS so please do not request. When you add your proposal include the aforementioned code.
There is an existing Hadoop (GCP Dataproc) solution that aggregates data from GCP BigQuery and outputs results to the database on a hourly basis. Data aggregation is done with a Spark Job (Java). We need to migrate everything to a fully managed Dataflow pipeline (apache beam). Please apply only if you have experience with GCP and Apache beam
Description UI/UX Angular developer Primary...UI/UX Angular developer Primary Skills UI/UX angular, Ajax Description Need UI/UX angular developer, professional in Angular development including Angular 8 and above Good Understanding of Observable model pattern in Angular. Well versed with UI/UX development. Have good understanding of how to create RESTful API client and map data models in Angular Good at designing the screen navigation and dataflow and exchange Should be well versed with Bootstrap for responsive web design and use of themes. Should have the understanding of Ajax Should have knowledge of working with third party tools(including components) for design and development. Well versed with source control. Worked on Linux environment. Good at debugging issues Good comm...
I have an Apache Beam project running with Dataflow and java. I have faced many problems detecting a bug and also understanding the Apache Beam model. Specifically with the GroupByKey Transform and its workload distribution among several machines. I would like to have a personalized session with a programmer how can help me found and correct the bug in the platform.
I have a data flow(beam) job written which reads from pubsub and writes to an API endpoint. I need to create micro batches by windowing or other techniques
Its full-time role for 11 months contract. Working location is Bangalore Data Engineer – Google Cloud Platform Technical Requirements • BA/BS degree in Computer Science, Mathematics or related technical field, or equivalent practical experience. • Experience in Cloud SQL and Cloud Bigtable • Experience in Dataflow, BigQuery, Dataproc, Datalab, Dataprep, Pub/Sub and Genomics • Experience in Google Transfer Appliance, Cloud Storage Transfer Service, BigQuery Data Transfer • Experience with data processing software (such as Hadoop, Kafka, Spark, Pig, Hive) and with data processing algorithms (MapReduce, Flume) • Experience working with technical customers • Experience in writing software in one or more languages such as Java, C++, P...
I need to detect the dataflow from server to an app. You shall have an Iphone 6 or similar. We need to know how the collction views(are loaded with images) You download the app and detect the dataflow in some way :-) I need to know all about the dataflow. We need to see entire dataflow
Natural Language Processing (NLP) and Machine learning with a strong background in dynamic topic modeling (e.g. LDA) Experience with different Neural Network algorithms such as Burt, CNN, ... Strong knowledge of Google AI and DB platform including but not limited to Tensorflow, Dataflow, Big Query, Datastore,... Strong knowledge of Spark (for dataflow) as well as Python. Previous experience working with big data and large datasets. Previous experience working with NLP projects.
Role...provide data model reporting to Business Unit Master Users Qualification & Experience · MBA or MBA IT(Preferred) with 4 years experience in Data Modelling for Business or data Lake Environments, or · Degree in Information technology with Business Experience Or Business with IT Skills/Experience - 4 years experience in Database, Basic ETL and Business Intelligence Tools i.e. Power BI Apps, Dataflow, Security and Admin · Skills & Knowledge · DB Concept design and Cloud D...
Looking for a support with experience in GCP services most of them into Data like DataProc, DataFlow, Pub/Sub and BigQuery. • Experience with snowflake as well, should be able to make decision in between BigQuery and Snowflake with regards to maintenance, cost efficiency and ease of use. • Should be able to do Architecture Validation, Security Validation and CellStack Validation. • Experience with GCP networking as well like building VPCs, maintaining Firewalls when data is coming from outside in BATCH. • Should be able to make right choice for Platform automation to reduce cost and also automate ETL process (Dev Ops) etc. • Experience in Bigdata tools like Hadoop, Spark and knowledge of PySpark.
I am looking for an Azure experts to help out with a little project on how to set-up the dataflow attached to the look at the diagram attached,I need someone who could work with me in setting it data factory pulls data from file folder and stores it on Azure datalake or blob then moves it to Azure databricks for processing,then finally to data have experience in Azure data factory,Azure datalake,Azure databricks.
...collaborative pad • Option to attach documents • Kanban view • List view • Quotation shall be created from the confirmed deal which then also create a link between a deal & quotation • Marking the deal as won or lost • Notification center for assigned tasks, confirmed deals etc • Import/Export mass update of all leads/deals • Audit Trail • Report with data group feature Form fields, list view, dataflow of leads from starting until it matures will be discussed after awarding the project. • Search/Filter 5. SALES MODULE • Quotations form • Customers (linked with contacts module) • Payment terms form (linked in sales quotation form) • Quotation design form • Terms & Conditions form (linked in sales ...
Our company offers IoT solutions to our customers. Recently, we started an account for GPS units. We need an expert in backend development that has done this before, to help set up our API's. You MUST have experience with AT&T Dataflow and/or Control Center and know backend development. We have all the API's from AT&T and everything you would need. We run a MERN stack.
Looking for a Zoho expert for creating a custom database in Zoho one. Using any of the Zoho One apps and creator as needed. Will need to customize the CRM, Forms and add auto email responders to coordinate with Zoho sign.
Greetings from Fullfilledplacements Our client is a group of hospitals providing nurses to all departments Openings for female staff nurse /sr staff nurse (Saudi Arabia) Note only female candidates Desirable Candidate profile Skills and qualifications Bsc nursing /GNM At least 2 years of experience in 100 beded hospital Saudi prometric and dataflow done or willing to start urgently Perks and benefits Free food +accomodation Shift wise 9 hours duty and rotational offs Vacation as per Saudi labour law Salary will be 3500SR-4500SR Contract will be for 2 years Share your documents in PDF FORMAT ONLY marks cards Degree Experience letter/still working/last salary slip/appointment letter Nursing council registration Resume Passport size photo with white background First and last ...
Our team is unable to achieve adequate parallelism on our Dataflow project. Please see the following StackOverflow post for details:
We have a product running on Google IoT using dataflow, pubsub and bigquery. We need to heavily reduce the cost of running our system and need an expert consultation to view our current set up and walk us through optimisation strategies to reduce data and cost.
Someone who is familar with following technlogies: 1)Google Cloud 2)DataFlow 3)BigQuery 4)DataProc 5)Data Fusion 6)Cloude Storage
...are looking for professional with experience on: - Collectign Big Data - Large scale applications - Designing architecture - MapReducers etc Our current situation: We are launching our almost ready product, it has been on local development and there is alot big data that we have stored using MySQL and Elasticsearch. MySQL wont be option when we go to production version, so you job is to design dataflow of our application. We give use cases, what we want to do with data, and how we want to access them. You job is design solution that is best for us. Key questions we want to know: - What database we should use to store all data? Cassandra? Postgresql? Hadoop? etc... - How to transfer data from clients website to our API fastest and best way? REST? RPC? Sockets? Etc... What to k...
Hello, It is time sensitive project. I have R&D project which will require to implement Single S...Naiad application. Here is the link for Naiad application - () readme, which will assist you run few examples on Naiad. Please do some study and let me know if you are ready help me to implement SSSP on Naiad. If you want more information then I can share with you. Naiad Project details - ). You will require to understand Naiad work flow and implement SSSP on it, there have few example running on Naiad. I can share updated code which are running without any issue if you are ready to work on this project. If this 1st task goes well with you, I will provide you more ones.
to draw diagrams for e commerce use cases , dataflow
Face to face 1 day workshop in Kuala Lumpur! Our company is looking for some introduction of Sharepoint. Since we are an on-line working CRM company, we wanted to upgrade our current system and manage our employees over sharepoint and Teams. We bumped into some issues regarding the dataflow, synchronising of documents and privacy-who can see what and how everything communicates with each other. We work on an external server from where our employees connect through a vpn to a windows 7. Please let us know if you can offer a 1-day workshop dive into the essentials of sharepoint (live in Kuala Lumpur). (After the one day we will determine if we can continue to work on Sharepoint internally or we hire an agency to help us out with for setting it up).
Dear, I need couple of methods to be implemented in C++, as follows; 01. In the - Using LLVM implement reaching definitions analysis. 02. In the - by using LLVM implement liveness analysis. Thanks for find attached to this email the instructions.
I have a python code and I need help it running on Dataflow GCP
...| 890 | 829 | 9 The New York Times | APPLICATION & DATA | Google Kubernetes Engine | Deploy, manage, and scale containerized applications on Kubernetes, powered by Google Cloud | 616 | 500 | 63 The New York Times | APPLICATION & DATA | Google BigQuery | Analyze terabytes of data in seconds | 507 | 373 | 92 The New York Times | APPLICATION & DATA | Google Cloud Dataflow | A fully-managed cloud service and programming model for batch and streaming big data processing. | 82 | 83 | 0 The New York Times | UTILITIES | Google Analytics | Enterprise-class web analytics. | 79.9K | 14.3K | 5K The New York Times | UTILITIES | Twilio SendGrid | Email Delivery. Simplified. | 5.3K | 2.6K | 712 The New York Times | U...
I need a simple c# console application with few features - In one shot i'm able to get atleast 100 subscriber count - The process shuld be multi threaded ( thread we need to use ) - Finally explain the dataflow of the application
Task is to create a dataflow in NIFI that takes a Json file, takes relevant fields and splits this Json file into 2 separate Json files. One of the files is then converted to SQL and put into a Mysql table which returns an auto generated ID. That id is then merged with the other Json data and put into another table in Mysql i.e. the data is connected. Everything is set up in a test server already, with Nifi and Mysql running with test data available. Processor are also set up so you can see exactly what fields are used and going into to DB tables.
Project Description: Generating CSV reports for JSON data (Avro schema) from a streaming platform (KAFKA) using Apache NiFi. We are a Consumer. Special Instructions: 1. Daily batches are streamed into KAFKA. 2. Need to c...consume data from Kafka (AVRO Schema/JSON content). 3. Schemas are registered in Confluent Schema Registry. 4. Need to transform required fields from the JSON messages and create csv files. 4.1. - Each batch has different products. (ProductType field) 4.2 . Need to create a single file for each products. 5. Technology - NiFi, ExecuteScripts (preferably Groovy) Relevant Files: NiFI Dataflow xml We have some very specific requirements that we would like to discuss on. Some of the works have already been done. Let us know if you would like to help us....
automate dataflow of geospatial data using apache nifi. customise processors to automate the data.
Connect simple Web Socket in Apache Nifi, create dataflow, put data to mongodb and then to Zepllin
Just need to convert data-flow diagram to logical diagram in visio.
I need a person with advanced knowledge in administration and development within the tool: Informatica Cloud: Data Integration , Loop, versioning , DataFlow , Mapplets and more.
Simple App with geo location like: " Tap - find water anywhere" (look in app store) same functions in front end and backend PLUS There is no login. If user cr...we rate with green stars. (you must stay nearby a location to rate it, like 20 meter. You can only rate a tap water location once in hour. It will not make sense if you can rate a tap water locations 100 time in an hour) You have iphone6 or more. We pay for finish vers. 1. of IOS app We make vers. 1 for IOS app and then Android after You make the design I approval You make wireframe, mockup, dataflow Show me an app you have make with similar functions When we work, you sent sourcecode every time we ask for it. I have make several app before. It can be your benefit or NOT. You decide. Write "WATER" s...
hi! i need exact system with little style changes and extend export part with js and dart options
Creative webdesigner We make presentation in pdf file or psd file. First we make 2 or 3 eg. pdf files. Then we make "finish" mockups of all steps and provide dataflow cart. Before we award you must show us a sample. Reference and link have no interest. I have make a screendump of out site and attached it total budget is 250 dollars
Look at the attached site. We need a copy of that. All data is free but we need to collect them with different API The speed of our site must be the same or faster. we control that from users in DK. We need full describtion of the project, dataflow, etc.
Trying to understand the Apache Beam framework with Google DataFlow runner, run few templates in Java or Python
We need someone who can work on High Level Architecture Diagram, Dataflow Diagram, Security Diagram and Interface Specification
...cybersecure by checking a design against a maintained threat database. ThreatGet will highlight any cybersecurity issues found in the design and also provide hints/recommendations on improvements. The first domain ThreatGet is tackling is the Automotive domain. Here, ThreatGet provides system designers with modelling elements like ECUs (electronic control units), different sensors and links for dataflow among others. Using these elements the designer can model the system under development. Once the model is available, ThreatGet will do a cybersecurity analysis based on threats from it's database. Based on these findings, the designer can then improve the system design. ThreatGet's database of cybersecurity threats is constantly updated by the ThreatGet dev team to stay ...
Hello We are looking for an Senior Machine Learning developer with 5 + years of expeirnce. Description: Objective: Build a scalable machine learning pipeline to train machine learning models on radiology images on Google Cloud Summary: I nee...pipeline would use CT images stored on GCS (as individual dicom files), labels, do preprocessing/conversion (likely to png), and then train a 3D CNN CloudML model using the different examples. A good example is this codelab published by Google cloud: Their proposed pipeline is GCS -> Dataflow -> CloudML but I'm open to other suggestions. Deliverable: A functioning, scalable pipeline to train a 3D CNN model from whole stack CT images.
...chosen technology for these data pipelines is Google DataFlow which has been open-sourced by Google and re-branded as Apache Beam. There are two Google Apache Beam SDKs: Java SDK and Python SDK. We expect you to be able to work with both. Test The test is a typical de-normalization task that is performed frequently when loading data to BigQuery. The test itself doesn’t require interaction with BigQuery, as we find that final output of transformed data to BigQuery is the easy part. The transformations in Google DataFlow are more complex and this is what we would like you to do. You’ll be given 3 files in gzip-archived JSON format that we receive from Spotify API: streams, tracks and users. Your job is to develop two pipelines in Google DataFlow (one in...
Develop a proof of concept app using Android and iOS, Google Firebase Analytics, Google Dataflow and Datastore. #Phase 1 – Proof of concept In this phase you will develop a proof of concept app and backend that shows you know what you’re doing. Below is a list of the components that need to be built. Client App - send event upstream (iOS and Android) +Develop an iOS and Android app that has one screen, 2 buttons and a message display area. +When a button press occurs in the client app. +Store the state change message in the local database with a timestamp. +Get the oldest state message from the local database. +Send the message to the backend using FirebaseAnalytics.Event. +After sending, delete the message from the local database. +Check if there are more old messages...
Hi, I'm looking for a C# programmer who can make an application interface which connects COM interface of datavendor Taipan with Tradestation 2000i, whic...beyond my budget, then the second option is: - a 64bits COM add-in for Excel 2010-2016 x64 - an application to retrieve missing intraday (D-T-C-V-OI) and daily (D-O-H-L-C-V-OI) D = Date. T = Time. O = Open. H = High. L = Low. C = Close. V = Volume. OI = Open interest. If desired, I can give access to the Taipan subscription. I can also provide access to my pc via Teamviewer. For setting up the dataflow through COM, instruction from Taipan is available at The German text can be translated at to understand the instructions. I would like also the source code of the solution.
I need a new website. I need you to design and build it. I want a simple 10 page 5 admin 5 user page php site With dfd and dataflow diagram
I need an experienced developer who can build me a small part of a webapp using modern framework of react + redux , with a mocked up dataflow (backend development not required) Screens mock will be provided by me. Main functionality is a basic crud operation for data sources on client machine, selection of tables using connection string, and persisting the table specs using already provided node js apis. The main functionalities expected are: 1. Login flow using 3rd party providers 2. User should be able to select data sources, tables etc on his machine and persist the connection string and credentials using apis 3. User should be able to group the selected columns by creating custom groups and save the mappings 4. User should be able to perform crud operations on these groupings,...
Hello, I m looking for someone to add a domain to my communities Actually the url of my community are : I would like to change this url to I have already buy the domain And after if you have skills on Eintein I will be interested you set the dataset and dataflow
Hi Pavan B., I noticed your profile and would like to offer you my project. We can discuss any details over chat. I have a need to add a domain to my communities Actually the url of my community are : I would like to change this url to Is it possible for you ? How long and how cost ? I have already buy the domain A...can discuss any details over chat. I have a need to add a domain to my communities Actually the url of my community are : I would like to change this url to Is it possible for you ? How long and how cost ? I have already buy the domain And after if you have skills on Eintein I will be interested you set the dataset and dataflow
